High Performance Land Surface Modeling with a Beowulf Cluster
نویسندگان
چکیده
We designed the Land Information System (LIS) to perform global land surface simulations at a resolution of 1-km or finer in real-time. Such an unprecedented scale and intensity in computing pose many challenges. In this article we will demonstrate some of our unique developments and implementations in high performance computing with a Beowulf Linux cluster, to meet these challenges and reach our performance goals. These contributions include a fault-tolerant job management system for the cluster, high-performance parallel I/O based on GrADS-DODS (GDS) servers with dynamic load-balancing and distributed data storage, and highly scalable data replication with peer-to-peer (P2P) technology.
منابع مشابه
Achieving High Availability by Implementing Beowulf Cluster
A computer cluster is a group of tightly coupled computers that work together closely so that in many respects they can be viewed as though they are a single computer. The components of a cluster are commonly, but not always, connected to each other through fast local area networks. Clusters are usually deployed to improve performance and/or availability over that provided by a single computer,...
متن کاملThe Bladed Beowulf: A Cost-Effective Alternative to Traditional Beowulf
We present a new twist to the Beowulf cluster — the Bladed Beowulf. In contrast to traditional Beowulfs which typically use Intel or AMD processors, our Bladed Beowulf uses Transmeta processors in order to keep thermal power dissipation low and reliability and density high while still achieving comparable performance to Inteland AMD-based clusters. Given the ever increasing complexity of tradit...
متن کاملThe Scyld Beowulf System
Beowulf systems are high performance computers constructed from commodity hardware connected by a private internal network and running an open source operating system infrastructure. This tutorial will cover design, installation, deployment and running Beowulf clusters. It will be focused on the Scyld Beowulf system, and will include specific examples and a complete cluster installation CD-ROM.
متن کاملThe Bladed Beowulf: A Cost-Effective Alternative to Traditional Beowulfs
We present a new twist to the Beowulf cluster — the Bladed Beowulf. In contrast to traditional Beowulfs which typically use Intel or AMD processors, our Bladed Beowulf uses Transmeta processors in order to keep thermal power dissipation low and reliability and density high while still achieving comparable performance to Inteland AMD-based clusters. Given the ever increasing complexity of tradit...
متن کاملDevelopment of Beowulf Cluster to Perform Large Datasets Simulations in Educational Institutions
This paper presents the design and development of the Beowulf cluster that can be used by institutions to perform research that requires high performance computing. In many industries and scientific applications there is often a need to analyse large datasets using computational power of distributed and parallel systems. The High Performance Computing (HPC) components are very expensive but wit...
متن کامل